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@ Optical means for making measurements of surface contours. 



@ A system for producing data to represent the 
three-dimensional shape of a surface including a 
projector for projecting patterns onto the surface. A 
sensor for producing representations of selected im- 
aged patterns as projected onto the surface, and a 
device containing data that represents the relative 
positions of the projector and the sensor for process- 
ing data produced by sensor to generate output data 
that is representative of the shape of the surface. 
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OPTICAL MEANS FOR MAKING MEASUREMENTS OF SURFACE CONTOURS 



Background of The invention 



The present invention resides in a novel sys- 
tem for obtaining information representative of the 
three-dimensional shape of an object in space and 
more particularly to a novel manner of developing 
projection patterns that can be projected onto the 
object each of which is imaged, the images then 
processed together in a certain way so as to mea- 
sure the surface form of the object It is especially 
important to the invention, to be able to project a 
number of patterns having light and dark areas, the 
positioning of such areas in the different patterns 
bemg formed so as to have certain properties of 
the edges that are formed by and between adja- 
cent light and dark areas in the different patterns 
which correspond to projected surfaces in space a 
major purpose of which certain properties is "to 
maximize the number of such surfaces that can be 
projected while maintaining the ability to unam- 
biguously identify each projected surface using 
only the sequence of images of the object. Profile 
ines or edges produced by different patterns will 
tall on the object to be reproduced. The pattern of 
the alternating light and dark areas is chosen to 
facilitate identification of these projected edges that 
fail on the object and are subsequently viewed and 
processed to measure the surface form of the 
object. 

There are various systems for obtaining data 
useful to produce three-dimensional representa- 
tions of an object. Such systems generally include 
a proiector of radiant energy and a corresponding 
image recording means. The three-dimensional 
surface recording technology has grown substan- 
tially over the last several decades resulting in 
even more such systems. One such system, which 
like the one disclosed here and many others dat- 
ing back to early in the 20th century, e.g. Smith in 
U.S. Patent No. 891,013. and Edmonds in U S 
Patent Nos, 1.485.493, 1.615.261 and 1.716 768 
and earlier by Willeme in U.S. Patent No. 43,822' 
and more recently by Cruickshank, U.S. Patent No' 
4.613.234. and Patent Application Serial No. 
786.322. and Morioka in U.S. Patent Nos 
3.580.758, 2,066.996. 2.350.796. 2.015.457 and 
1.719,483; and in British Patent No. 439.448, as 
well as Jeffreys British Patent No. 471 .61V. com- 
prises a camera-projector pair for the development 
of a data file which can be stored or used for 
subsequent representation of three-dimensional 
surface configurations, and is disclosed by DiMat- 
teo at al in U.S. Patent No. 3.856.052. With this 
and all such similar types of systems, the three- 



dimensional object to be recorded is placed in the 
field of projection of a light or other type of radiant 
energy projector, wherein the pattern of the projec- 
ted light is structured in accord with the method of 
5 the particular invention. The surface of the object 
intersects with the projected light pattern in forming 
the reflected radiant energy. The radiant energy 
reflecting from the object is also within the field of 
- view of the objective lens associated with a camera 
w element. The geometric fixed relationship between 
the object, projector and camera lens is known and 
such information is subsequently employed togeth- 
er with the reflected radiant energy pattern in re- 
presentating the surface configuration. 
^5 A concern of manufacturers and users, of such 

systems is how to define a coordinate system 
which can be maintained and which facilitates the 
gathering of reliable data about the location and 
surface characteristics of the subject object; and 
20 from^ this information to identify with precision the 
spatial location of a point or series of points on the 
objects's surface. 

The approach claimed in U.S. Patent No. 
3.866,052 is well known in the prior art. See. for 
25 example, D. Galas. "Theory and Computer Im- 
piementation of Image Processing by Boolean Fil- 
ters". Washington University of St. Louis Master's 
Thesis. 1970, as well as his references to preced- 
ing literature. 

^0 In light of the foregoing comments, it will be 

understood that a principal object of the present 
invention is to disclose a method of obtaining high- 
er resolution three-dimensional representions of an 
object from fewer sequences of projections and 
35 recordings than is presently possible, and to obtain 
a given resolution with fewer projections and re- 
cordings. This also means that fewer projections 
and much less time is required by the present 
system to obtain data from which to gather in- 
^0 formation as to the shape of a surface contour. If 
the information is to be used in the reproduction of 
the shape of an object or person it means that the 
object or person needs to pose for a very thsort 
time, typically less than one second. 
-5 An additional object of the invention is to pro- 

vide a method of digitizing data to enhance its 
interpretation and to produce a three dimensional 
representation of a surface. 

Another object of the invention is to teach new 
so and enhanced methods of profile line identification 
in the recorded image. 

Another object is to locate, identify and de- 
velop data representative of profile edges projected 
onto an object and viewed by camera means. 

Another object is to provide means to deter- 
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mine the location of points in space along a profile 
line projected onto an object and to produce data 
representative of said points in space. 

A further object of the present invention is to 
provide a method of viewing, digitizing and pro- 
cessing of data to produce a quantitative measure 
of the viewed object. 

A still further object of the present invention is 
to provide means of obtaining data useful to create 
an enhanced detailed representation of a viewed 
object without increasing the number of required 
mask segments. 

Another object is to provide a three-dimen- 
sional representation means to enhance and ensure 
the accuracy of obtained data by systematically 
locating and identifying the location of profiles in a 
viewed image. 

A further object is to obtain data corresponding 
to surface characteristics irrespective of the surface 
reflectance characteristics of the scanned object. 

Yet a further object is to provide a novel meth- 
od of accurately locating profiles using projected 
patterns and their functional inverses. 

These and other objects and advantages of the 
present invention are realized by the present sys- 
tem which is based upon the light beam profiling 
principles described in John Cruickshank's portrait 
sculpture U.S. Patent Nos. 3,796,129. 3,690,242 
and 3,688,676. The basic concept disclosed in the 
Cruickshank patents is to recreate three-dimen- 
sional objects without requiring physical contact 
with the sensed object. ' 

The method described in the Cruickshank pat- 
ents utilizes the projection of a single planar sur- 
face, or sheet, light from a single projector to 
intersect the surf ace. of the subject to be sensed; 
and a single photographic camera, positioned apart 
from the projector, to view and record an image of 
this light intersection, or "profile". In these patents 
it was shown that by knowing the positions and 
orientations of the projector and camera, as well as 
the focal length of the camera lens, the image of 
that profile can be projected onto a screen placed 
at a proper distance and angle from the projector 
to form a viewable image of a profile corresponding 
in size and shape to that created upon the original 
viewed surface. Through the process of moving the 
sensed surface and the projected light plane rela- 
tive to one another, with or without concurrent 
movement of the camera as necessary, such pro- 
files can be repeated at multiple positions over the 
surface so as to represent multiple profiles, which 
through a process of interpolation, can be used to 
represent the sensed surface. As disclosed in the 
Cruickshank patents, the system was used to man- 
ually trace the projected profiles so as to control a 
cutting machine to produce an approximate replica 
of the sensed object's surface. 



The present system is an important improve- 
ment over the known prior art. including the Cruick- 
shank patents. To generate a representation of part 
or all of a subject surface with the present system. 
5 spaced multiple light sheets produced by light 
sources including a laser light source are projected 
at the same time. Here, we include "light sheets 
and "profiles" to be defined in the edge information 
between light and dark areas, that projected sheet 

w or boundary forming a surface in space, intersect- 
ing in a line on the subject called a "profile". They 
intersect the subject giving it a zebra like appear- 
ance and are viewed together. With this system, 
instead of requiring N images to be processed for 

/5 N profiles, multiple boundary surfaces are projec- 
ted at once and only a smaller number of images 
need be viewed and processed to locate the resul- 
tant intersection profiles due to a novel technique 
for creating the patterns which uniquely identifies 

20 and con-esponds the profiles in the viewed image 
with the projected surface that created them. 

Once the imaged profiles are identified, it tt is . 
desired to sense more of the surface than is in 
common view between one projector of mump e 

25 surfaces and one camera, then the projector, sub- 
ject, and camera, or any one or two of these, can 
be moved and the process repeated to obtain 
information about additional portions of the ^^^^^^^ 
The amounts of any such movement must e 

30 known quantitatively and employed in the solution^ 
!t is also contemplated to use a plurality of space 
stationary projectors and cameras, preferably >n 
.darkroom, and to strobe the projectors in a se- 
quence so that all or any desired surface portion o 

35 the object can be viewed and the data obtaine ^ 
processed to produce either a part or a full three- 
dimensional representation. 

The projection patterns employed with e 
present system are uniquely designed in ^^^^^'^ 

40 dance with the present invention to facilitate ta©"' 
tification and correspondence of the profiles m t e 
viewed image with either the light sheets or e 
boundaries, or edges, between light and dark por- 
tions of the projected pattern. Briefly, the scheme 

45 is one of arranging light and dark banded ^^^^^ 

at least two projected pattems, such that they "^^^^ 
certain properties. One method of generating a se 
of patterns that meet these properties is f^j^ 
In this example, each pattern correlates to a 1 * >^ 

50 long cyclic generatric code. Using this code a 

basis, a much longer code is generated that as 
the desired properties of uniqueness throughou i ^ 
length, and meets the chosen properties throug^ 
out its length. By locating a profile in the "^'^"^^^ 

55 image, through a process of reading the co^^^ 
corresponding to the viewed image, the c 
spending profile in the projected pattern can 
identified, and the accuracy of the identification c 
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be checked and if desired cross-checked 

The patterns also may be projected in the form 
of thin sheets of light rather than dark-to-light or 
l.ght-to-dark boundaries or edges. This is done bv 
proiecting a pattern of thin light lines on a dark 
background, or vice versa. 

The more boundaries or light sheets that are 
projected at once, the truer the resultant surface 
modeling. However, if they become too closely 
spaced, then optical and camera resolution may 
not separate them in the viewed image, thus losing 
the information carried by the denser profiles ' 

The exact spacing is also a subject of the 
present invention and is detailed in what follows 
vinuT' ^"J':;P°'^="f ^^^^"tage is that, unlike pre- 

ZiLT: f "^'"^ patterns 'the 

projected surfaces are approxmiately evenly dis- 
nbuted among the multiple pattems. thus permit- 
fng the greatest number of profiles for a given 
number of pattems. concurrently permitting the 
gre^itest separation between profiles in any given 
■mage. Furhter, unlike previous methods, profiles 
need not repeat at the same place in more than 
one pattern. The importance of maximizing the 
separation between profiles in any one pattern is 

dild ^fJ" The problems asso- 

ciated with dense profile packing are alleviated in 
he present invention by utilizing a series of pat- 
terns, which are normally projected and viewed in 
JmuT.T ^'^'^'''^^ Viewed 

through the use of different colors, polarigations or 
combination thereof. In any one view, the prof es 
are sufficiently separated to resolve; and by inter- 
laaying these sets of pattern profiles any Li ed 
aggragate number of profiles can be obtained, at 
the expense of projecting and viewing a sequence 
Of pattems. But the number of images for a given 
With ""fr °l smaller than 

plid.? ' °V'' '''''' -ethod 
provides uniquely identifiable profile lines , as will 
be explained. Since within a given image it is 
known which subset of the total number of profiles 

Z7J '"T' "^^^^^^^ '° •■'^^niify the 

profiles within the respective subset for each given 
-age^ This in „rn is made possible by using 
different spacings among the lines or edges in any 
one pattern, the spacings chosen to make a unique 
nterleaving sequence among the pattems. this in- 
terleaving sequence either not being repeated 
hmughout the pattern, or it repeated I'hen prov.d- 
•ng additional identifiers to resolve them, thus per- 
mitting unique identification of all profiles by ob- 
serving their sequencing with respect to all the 
patterns This is one of the key features of the 
present invention. Further, in another embodiment 
complementan/ additional patterns can be used to 
enhance the accuracy of locating a profile edge 
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instead of moving the projector, camera, or 
subject or a combination of these to sense more of 
the surface than is in view between one projector- 
camera pair, multiple stationary cameras and pro- 
jectors can be used to observe more (or all) of the 
surface, thus requiring no motion. 

Srie_f Description Of The Drawings 

Rg. 1 is a perspective view of the main 
components of the present system and their ori- 
entation; 

f^'O- 2 is a raster produced by a video cam- 
^5 era with an image of an object to be represented 
showing a few typical profile lines formed thereon; 

Fig- 2A is a plan view of the projected pat- 
tern that produced the profile lines on the object of 
f'ig. 2; 

^9- 3 is a simplified diagram to illustrate a 
pattern that can be established for use by the 
subject device; 

f^ig. 4 is similar to Rg. 3 but shows a com- 
plementary pattern; 
25 Rgs. 5 and 6 are views similar to Rgs. 3 and 

4 but showing a greater number of boundary lines 
in a given space; 

Fig. ,7 shows a graphical construct used in 
the explanation of a sub-pixel interpolation method 
00 that increases the accuracy of mensurating profile 
positions within imaged views of a pattern-illumi- 
nated subject; 

Fig. a shows a rotatable disc having a seg- 
mented annular patterrr for projecting by a projec- 
ts tor onto an object to be represented to produce the 
profile lines thereon; 

Fig. 9 is a code representative used for 
determining the spacing and widths of opaque and 
transport area at the location as taken on radial line 
^0 9-9 in Rg. 8; 

Fig. 10A is a graph based on the data in Rg^ 
9 and 10; 

Fig. 10 is a solution chart which corresponds 
to a typical 6-bit code representative of the code 
Shown in Rg. 9; and 

Fig. 11 is a schematic block diagram of 
circuitry for controlling the operation of the projec- 
tors, cameras and for producing the information 
outputs. 

50 

Pgg££iSi!on Of The Preferred Embodiment 

The present invention comprises unique and 
55 novel pattems which are used to uniquely locate 
and Identify profile lines in a recorded image and 
to correspond these identified profile lines with 
surrace in the projected patterns. These profile 
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lines are created on the surface of the object to be 
represented in three-dimensionai form. Information 
is also gathered, which correlates the location of a 
projector and the projecter surfaces, the locations 
of the camera or cameras and recorded profiles as 
well as other information with respect to a common 
coordinate system. The information thus gathered 
is processed to establish three-dimensional data 
points which can then be used for whatever pur- 
pose may be desired, including the control and 
operation of a replicator to produce a three-dimen- 
sional model of the viewed object. 

In its most general form, the goals and objects 
of the present invention can be explained and 
obtained using one pattern having two identifiable 
boundary lines thereon in a one camera, one pro- 
jector system. Other more generally useful embodi- 
ments with multiple patterns each having additional 
identifiable boundary edges profiles thereon will be 
disclosed in what follows herein as well as embodi- 
ments utilizing multiple camera-projector pairs. 

The system 10 of the present invention is 
shown generally in Fig. 1 as comprising a projec- 
tion means 12 for projecting light or other forms of 
radiant energy onto an object such as 24; a record- 
ing means such as video camera 14 or any other 
means of imaging or photographing the object 
which is to be measured for some purpose such as 
to be reproduced; and control means 16 to control 
operation and synchronization of the projector and 
recording means and to read and analyze the im- 
aged data, and a processing means such as host 
computer 17 to further process the obtained data to 
extract the three-dimensional surface informaion 
and present it in a useable form. These means will 
be detailed in what follows herein. 

The projector 12 is equipped with means {not 
shown) for positioning at least one and up to a 
series of two or more mask patterns in the field of 
view of the projector's objective lens in order to 
focus the mask patterns onto the surface of the 
object whose surface is to be measured and repro- 
duced if desired. The details of the projector 12 are 
disclosed in co-pending application Serial No. 
filed April 29, 1987. Other projection means can be 
used as well, the only requirement being the pro- 
jection of patterns in space having the properties 
specified herein. 

The video camera's and projector's optical 
axes are aimed so that the object of interest lies at 
least to some extent within their common view. The 
distance between the camera and projector must 
be greater than zero and needs to be known quan- 
titatively, as do the locations of the camera's and 
projector's optical axes. Normally, these axes are 
chosen to intersect at an angle between about 20 
to 60 degrees. However, intersection of these axes 
is not essential to the concept. A general coordi- 



nate system is specified; the origin of which is 
most often, but need not be. established at or near 
the object of interest. The camera and projector are 
placed within the system such that their x. y. 2 
5 position coordinates and angular orientation coordi- 
nates are known relative to the general coordinates 
of the system as thus as well to each other. This 
informational data along with additional data which 
locate the positions of the image planes ot the 
10 camera and projector and their focal points (or lens 
centers) relative to the general coordinate system 
as shown in Fig. 1 is obtained and stored for use in 
subsequent processing. For processing and com- 
putational purposes, this data is obtained in both 

15 angular and linear forms and is normally stored m 
appropriate means such as in a computer's Ran- 
dom Access Memory (RAM). 

The surface of the object 24 is illuminated and 
imaged in sequence using mask patterns, which for 

20 example may be located on a rotating transparent- 
disc 18 in the projector 12, and if it is desired to 
sense more of the surface than a one camera ana 
projector pair can view at once, then in alternative 
embodiments several projectors and video cameras 

25 can be arranged so that a designated portion of, or 
the entire object surface can be illuminated by 
pattemed projections of light or other radiant en- 
ergy for recording, or a single camera-projector 
pair can be moved, or the object of interest can be 

30 moved, or a combination of these, as long as the 
desired surface area is illuminated and recorded, 
and the spatial positions and orientations of the 
cameras and projectors are known in relation to 
one another and to the general coordinate system. 

35 The operational concept of the present system 

is that the intersection of a line and a surface 
defines a point in space, and that by defining a 
number of such points on a sensed surface, 
surface can be deiscribed by these points. An alter- 

40 native operational concept is that the intersection o 
two surfaces in space forms a line, that line defin- 
ing a contour on the surface of the subject, and 
that by defining a number of such contour lines on 
a sensed surface, that surface can be described by 

45 these contour lines. By using beams of iigh^ projec- 
ted by the projector 12 having distinctive adjacen 
areas thereof of black and white or light and dark it 
is possible to separate the boundaries between 
these areas into as many lines as possible and as 

50 the system can resolve. The projected boundary 
line or edge between adjacent dark and light 
forms a surface inspace, which as it intersects t e 
surface of an object forms a contour line referred to 
herein as a profile. Alternatively, the projected sur- 

55 face may be defined by "stripes" of projected lignt. 
The light beam or beams strike the object, and are 
reflected and viewed by an imaging system sue ^ 
as a video camera which includes means asso- 
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oated therewith to record them at identifiable pixel 
locations as at locations on points 25 where a scan 
Kne crosses a profile in an image on a grid or 
raster type format as shown in Fig. 2. The light 
rays which strike the pixels at any given location or s 
ocations along the profiles depend upon the con- 
tour or shape of the object at the location of the 
proTile and. to some extent, the reflectivity of the 
object. 

The patterns pro/ected using the exampled w 
proiection means are arranged to have a plurality 
of clear and opaque sections forming a striped or 
zebra like pattern when light is projected thereth- 
rough. The clear and opaque sections have pre- 
cisely defined widths which correspond to a deter- ,5 
mined structure. In the simpliest form (Figs. 3 and 
4) when the system of the present invention is 
utilized with a basic simple code having only one 
such mask pattem 26 or 26A. the pattern should 
comprise either one opaque section and two adia- 20 
cent clear sections (Rg. 3) or one clear section and 
hvo adjacent opaque sections (Fig. 4). It is the 
boundary lines or edges that are formed by and 
between the adjacent clear and opaque sections on 
the mask pattem which are identifiable in cor-- 2s 
respondence with the imaged profile lines on the 
object of interest. 

With one camera and one projector focused on 
the object 24 to be reproduced, the projector when 
its light source is strobed will project a set of 30 
optically structured patterns which form corre- 
sponding profiles on the object. The mask pattern 
28 of Fig. a may be on a rotatable disc 18 or on 
some other similar means located in the projector 
12 between a light source 30 and a projector lens .5 
assembly 32 if needed. The patterns mai be either 
curved, such as in Rgure 8, or straight, as is most 
convenient to facilitate the projection orocess The 
Nght projecting through the mask pattem 28 pro- 
duces the zebra-like pattem on the object 24 and .0 
assuming preferably the object is in a darkroom 
the camera will record the image that it sees at its' 
vantage point which will differ somewhat from the 
projected form of the light depending on the con- 

wiil'h! "''i "^^''' """^ '° sensed 45 

wni be app ied to a frame or raster 34 (a portion of 
which IS shown in Fig. 2) established in the cam- 
era, which raster is made up of a matrix pattem of 
horizontal and vertical lines of dots, or "pixels- 
extending across the frame, normally in a square or 50 
rectangular pattern. For purposes of illustration the 

linpfw! 256 matrix 

ines. Wherever the profile lines 36 (Figs. 1 and 2) 
all on the frame or raster, it will be possible to 
formulate codes of data bits, the length of such 55 
codes depending on the number of mask patterns 
utilized and the number of profile lines on each 
pattern, which data bits are used to uniquely locate 



and identify the profile lines 36. Rom a single 
pattern having f/vo profile lines thereon a one bit 
code is formulated. The bit indicates wiietfier the 
transition at the location located along the profile 
line 36 is from light to dark or from dark to light, 
thus identifying which of the two profiles is being 
observed. If, for example, one mask pattern is 
utilized, the profile line at the transition from dark to 
light can be assigned the binary numeral 1 and the 
profile line at the transition from light to dark can 
be assigned the binary numeral 0. 

While the description deals specifically with 
means for the unique identification of every profile 
viewed, if ancillary means are also available to 
assist in profile identification, then complete resolu- 
tion of all profiles by the method described here 
would not be necessary. In these cases, more 
profiles can be employed in the image, i.e. in the 
current example more than two profiles. Thus, the 
first profile line 36 in Rg. 3 would be assigned the 
code 1 and the second profile line 36A assigned 
the code 0. This code can thus be used to uniquely 
identify specific points on each profile line in the 
recorded image. Because the number and widths 
of the respective clear and opaque (light and dark) 
areas of the mask pattern are known, it is determin- 
able from the code 0 that on the mask the profile is 
a transition from dark to light and further because 
there is only one such profile line 36 in the projec- 
ted mask pattern of Fig. 3 which could have cre- 
ated this code the profile line is uniquely located, 
identified and correlated. 

If the mask pattern of Rg. 4 is utilized the first 
profile line is assigned the code 0 and the second 
profile line would be assigned the code 1 and 
Identification is as previously discussed. 

This information for a number of points along 
the profile lines uniquely identifies the profile lines, 
the positions of which in the image further are used 
to formulate data sufficient to compute the three- 
dimensional points corresponding thereto. 

In an alternative embodiment wherein two suc- 
ceeding mask patterns 40 and 42 are utilized as 
shown in Figs. 5 and 6. each pattern can have up 
to four profile lines thereon, a total of eight, which 
can be uniquely identified along the lines indicated 
above. In this case, the identifying codes for each 
location on each profile line will have three bits and 
these bits are obtained from mask which are struc- 
tured to meet the requirements discussed in the 
following paragraphs. 

A desired total number of projected surfaces 
and their corresponding pattern boundary lines or 
edges positions are chosen so as to be consistent 
with requirements of the application. Although not a 
requirement, these pattem lines are normally either 
parallel or concentric arcs, spaced uniformly on the 
pattern, a number of patterns will be used, as will 
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be discussed. The pattern lines are allocated, each 
to one pattern, among the patterns, subject to 
certain requirements. Normally they are allocated 
in equal or approximately equal numbers to each 
pattern, as substantial advantages arise when the 
number of lines on a given pattern is at a minimun, 
and equal distribution minimizes the maximum 
number on any one pattern. Further, the pattern 
lines are assigned in such a way that no two on a 
given pattern fall closer than a specified minimum 
multiple of the aggregated-line spacing. An exam- 
ple will be given subsequently wherein this mini- 
mum multiple is three. 

Minimizing the number of lines allocated to a 
particular pattern reduces the chance of misiden- 
tification of one or more profiles, because there are 
then fewer profiles produced by any one pattern 
that could become confused with one another. 
Such confusion is otherwise more probable be- 
cause of practical limitations in manufacturing, 
measuring, imaging, and processing accuracies. 
The chance of misidentification is further reduced 
by increasing the spacing between adjacent pro- 
files; which also permits better mensuration. The 
property of allocating a profile to one and only one 
pattern, of allocating an approximately equal num- 
ber of profiles to each pattern, and of allocating 
them subject to a minimum spacing between pat- 
terns, all combine so as to permit more total pro- 
files, thus increasing the resolution of the com- 
puted three dimensional surface representation, 
and/or to permit increased minimum separation be- 
tween any two adjacent lines in any one pattern so 
as to greatly enhance the ability both to distinguish 
between them during mensuration and to correctly 
identify the profiles, as compared with previously 
available methods such as binary or simlarly coded 
patterns. 

Where the projected surfaces are generated by 
using projection masks, for example, the pattern 
tines may be represented on the projection masks 
as boundary edges between opaque and transpar- 
ent bands. Alternatively, they may be represented 
as transparent "stripes" on an otherwise opaque 
mask background. In either case, where "opaque" 
and "transparent" areas are referenced, it should 
be understood that this means any two distinguish- 
able transmittances, such as two different gray 
levels, two different colors, two differnt polariza- 
tions, or other detectable means of modulating the 
transmittance. Throughout most of the description, 
the example used will be one of opaque and trans- 
parent areas, and the method of representing pat- 
tern lines will be as boundaries between Nvo such 
areas. The same elemental principles apply in the 
case where profiles are represented by transparent 
stripes, although some differences in detail exist. 
These differences v/ill be described where they 



spply. 

A further property that may be required of the 
allocation of profiles among the patterns, if needed 
in a given application, is that uniquely identiriebie 
5 sequences of allocation must occur, when consid- 
ered along with other- identifier obsen/ations. the 
purpose of which is to permit adequate identifica- 
tion of profiles, necessary for properly measunng 
the three dimensional surface form, as will be 

w shown subsequently. To explain, consider a situ- 
ation where there is projected a sequence of pat- 
terns, each defining a number of surfaces in space, 
which are interleaved when considering all patterns 
in toto. Numbering each projected surface in the 

15 interleaved sequence with the number of the pat- 
tern in which it lies, an ordered sequence of num- 
bers is thus generated, one number for each pat- 
• tern surface. Consider, for example, two projected 
surfaces of the same pattern, which surfaces wi 

20 therefore carry the same identifying pattern number 
in the sequence. If the two profiles caused by 
these projected surfaces of light are not otherwise 
distinguishable, but if the sequences of numbers tn 
which they lie differ, then the two profiles are 

25 distinguishable on that basis. The allocations to the 
different pattern masks are made such that every 
pattem line on every pattern is uniquely identifiab e 
by considering a combination of observables in- 
cluding some or all of these, as maybe found 

30 useful or necessary in a given application, to wtt. 

1. the pattem in which it lies, found t^y 
corresponding the pattern number with the image 
number, 

2. the directiion of the boundary edge, 
as whether from a light to dark area or vice versa; 

3. the type of area, i.e. light, or dark, that lies 
at the corresponding position in' each of the re 
maining patterns, an available measure since 
other pattern will have a profile at the same posi 

40 tion. and 

4. The sequence of pattern numbers cor- 
responding to a sequence of imaged and men 
surated profiles. 

Note that item numbers 2 and 3 in this hst ar ^ 
45 available only to the boundary-line method of pro- 
jected surface representation, whereas items 1 
4 are available to the previously mentioned "stnpe 
or "light sheet", representation method as well- 
Since neighboring profiles are not always o ^ 
50 sen/able in an image, owing for example to e Q ' 
shadows, or obscuration, the sequence of 
numbered profiles may often be interrupted '^^T^^ 
given scan line, such that a profile that lies 
edge of such an interrupted sequence will not a 
55 one or more of its neighboring profiles ^ 
quence. In this case, the unique identification o 
profile such as this is accomplished by choosi 
that one of the possibly hvo or greater number 
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potential identifications that places.it in its oroper 
sequential position among the remaining uniquely 
identinable profiles of the sequence. 

The simple cases shown in Rgs. 3 through 6 
are given to illustrate these principles. In practical 5 
application, many more projected surfaces are nor- 
mally employed. Fig. 8, to be explained subse- 
quently. is an example of a set of four pattern 
masks, each with its complement opposite it on the 
circle for optional purposes to be explained, for a w 
total of eight patterns. In this example, a total of 
1 58 pattern lines, or boundary lines, are defined ad 
uniquely identifiable, as will be shown with the aid 
of Figures 9 and 10. More than the 158 pattern 
lines illustrated are also possible with four patterns /s 
To compare, for example, with binary coded meth- 
ods of the earlier art, with four patterns those 
methods are limited to a maximum of the number 
tv/o to the power of four, or sixteen, uniquely -iden- 
tifiable areas -1 / ^ • 

Although the illustrations given here show oniv 
the cases of one pattern, two patterns, and four 
patterns, it should be clear that any other number 
can be used as wed. applying the elemental meth- 
od described, and so are comtemplated as being 25 
withm the scope of the invention. Explanation of the 
examples is now resumed. 

The location of each boundary line in the first 
pattern 40 should be sufficiently offset lat--iiw 
rrom the location of boundary lines in the secoTid 30 
pattern 42 such that no projected profile 36 or 36A 
fronn the first pattern 40 creates a profile line in its 
viewed raster at the same location as a boundary 
Ime 36 or 36A from the second pattern 42 would 
create on its viewed raster. This condition is desir- 35 
able so as not to unnecessarily duplicate projected 
surfaces and necessary in order to produce iden- 
tifying information from the two rasters as to wheth- 
er the locations on the first raster that establish 
points along the profile lines or edges fall in light or .0 
dark areas on the second raster which, as in- 
dicated. has its profile lines at different locations 
than the profile lines on the first raster. This is 
important because with two patterns as shown it is 
possible to locate and identify at least eight profile .5 
(»nes. four from each pattern. However, if a viewed ' 
profile were to be located at the same position in 
both rasters, the second profile line would not 
impart any new information about the surface char- 
acteristics of the viewed object and would be es- 50 
sentially wasted, it is considered a primary feature 
of this invention that profile identification can be 
accomplished without need for the overlapping or 
coincidence of pattern lines among patterns. This 
IS achieved in the example which employs annular 55 
projection masks by locating the opaque and clear 
areas in the disc pattern 28 according to specific 
requirements as have been defined in genera! and 



as will be explained for the current example. 

With a one-camera and one-projector pair as 
discussed earlier, the projector 12 will project a 
first set of projection surfaces from pattern 40 on 
the object 24. The coded pattern of profiles pro- 
duced at the intersection of the projected light 
surfaces with the object is sensed by the camera 
and the various profile lines are imaged and placed 
on a raster. Wherever the profile lines fall on the 
raster, it will be possible to gather data bits includ- 
ing a first bit indicating which projected pattern 
created the profile and a second bit to indicate 
whether at the location of each point where the 
profile line occurs on the raster, the image transi- 
tion is going from light to dark or from dark to light. 
When a second different pattern image 42 is pro- 
jected a different set of pattern lines will be projec- 
ted onto the object 24. These projected pattern 
lines should occur at different locations from those 
that were projected during the time when the cam.- 
era image the profiles of the first projection be- 
cause of the different coding. These second profile 
fines are similarly sensed, image recorded and 
placed on a second similar raster. Then the pixel or 
matrix locations on the second raster device cor- 
responding to the same points forming the profile 
lines that occurred in the first raster device are 
looked at and if on the second raster device the 
corresponding point occurs in a dark spot, a third 
different bit of information will be produced than if 
the corresponding point occurs on a light spot. For 
example, if we define a "scan line" to be a horiaon- 
tal line in the image as shown in Rg. 2, which runs 
more or less perpendicular to the profiles, then a. 
given scan line crosses the boundary between ligHt 
and dark regions at definite points in the image that 
can be measured. When such a crossing is ob- 
sen/ed, it is necessary to subsequent mathematical 
solution for the spafial position of the correspond- 
ing point on the object that the particular profile for 
that point be identified. This is so that the correct 
projected surface can be used in the calculation of 
the intersection between said surface and the ray 
in space defined by the lens center of the camera 
and the point of intersection between the aforesaid 
scan-lineand boundary line in the raster. That is 
done by obsen/ing a unique sequence of obser- 
vables, or codes, to identify the profile. Continuing 
with the example, the device produces up to four 
three-bit codes for each scan line of the first raster, 
ff there are 256 scan lines a code is similarly 
produced for each one that crosses the profile in 
the image. By repeating the procedure using the 
second image raster, additional profiles are found 
and used to increase the detail and resolution of 
the measurement and ultimately three-dimensional 
surface representation. 

From scan line one of the first raster, four 
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three-bit codes are developed which identify points 
on each of -he profile lines 36 and 36A on the first 
mask pattern. If pattern or raster one is assigned 
the binary numeral 0 and pattern t*vo is assigned 1 . 
and if transitions from dark to light are assigned the 
binary numeral 1 and transitions from light to dark 
are assigned the binary numeral 0, and further if 
dark areas on the rasters are assigned the binary 
numeral 0 and light areas are assigned the binary 
numeral 1 , then using the raster recording shown in 
Fig. 2 as discussed above the following sets of 
codes are developed for raster 1 . namely, 01 1 , 
000, 010. 001, and the codes 101, 111. nO, and 
100 ere similarly developed for raster 2 not shown. 
It should be noted that these codes are not unique 
and can vary depending on the widths of the clear 
and opaque sections. In this two-pattern example, a 
total of only eight boundary lines is illustrated, all of 
which can be uniquely identified using only the 
pattern number, the boundary direction, i.e. dark to 
light or light to dark as the boundary is crossed 
from left to right and the dark or light state of the 
other pattern at a given boundar/ line position. Use 
of the remaining aforementioned identifiers, i.e. the 
sequence of pattern number, permits additional 
pattern lines to be uniquely identified. This is illus- 
trated in a subsequent example herein for the case 
of four patterns. For the present two pattern exam- 
ple, reading left -to-right the pattern number se- 
quence for the eight pattern lines shown is 
21211212, although its use is here not necessar/ 
for identification of the pattern lines. Also note that, 
while it is normally chosen to make the increment 
between successive pattern lines of the aggregated 
pattern lines from all patterns equal, this is not 
essential to the invention and Is not the case in the 
illustration of Fig. 5 and 6. 

The position in the image of the crossing point 
between a scan line and a boundary between black 
and white areas can be measured in a number of 
ways. One such preferred way is to establish a 
separate threshold intensity value for each pixel in 
the image, by a method to be described, and to 
note whether pixels in the observed image are at 
greater or lesser intensities than the corresponding 
threshold values at the same pixel locations. If an 
image pixel is at a grater intensity than the thresh- 
old, then it is assigned to the light area, else to the 
dark area. If any pixels exactly equal the threshold 
intensity, then they are said to lie on the profile line 
itself. Tracing the scan line across a boundary, it is 
observed between which two pixels the above as- 
signment changes, from light to dark, or vice versa. 
The direction of change, i.e. whether from light to 
dark or vice versa, is noted, and used as one of the 
profile identifier observations already discussed. 
The position of the boundary crossing point is then 
known to lie on the scan line between these two 



adjacent pixels, except that in the above-noted 
situation where an image pixel exactly equals the 
threshold then the boundary crossing point lies on 
that pixel position as already noted. 

5 In many situations, it may be desirable or nec- 

essary to find the crossing point more precise y 
than knowing only that it lies somewhere between 
two adjacent pixels. This can be achieved through 
a process of sub-pixel interpolation, which can, or 

10 example, take the form of the process described a^s 
below wherein the following symbols are define . 
preliminar/ to the analysis. 

k: The pixel number in scan line j 

immediately to the "left" (i.e. lesser pixel number) 

75 Of the boundary, one of the two adjacent pixe 
described in the preceding text. 

k 1 : The pixel number adjacent and to 
the "right" of pixel k. which lies on the other si e 
of the boundary, as described in the preceding 

20 text. 

1 (j.k): Image intensity of pixel k m scan 

1 {j,k + 1 ): Image intensity of pixel k + 

scan line j, : 
25 T a. k) Threshold at pixel k in scan Une ]. 

determined by a procedure to be described. 

x: Calculated estimate of the boundary 
position as measured from pixel k. 

P G. k) Position of pixel k along scan ime 

30 j raster. ^mna 
P G. k+1) Position of pixel k + l aiony 

scan line j of raster. 

w: ^ Distance along scan line betv/een 

pixels P{j.k) and P(j.k + 1). , ^-g, 

35 With reference to figure 7. the sub-pixe 

tance. x, is estimated. It is the distance from ^ u. 
to the crossing point of the two lines, i(x) ana K^^^ 
constructed as illustrated thereon. To solve 
point, and therefore solve for the value of eq^^ 
40 tions for these two lines will be employed, 
are: 

l(x) = (1-x/w)lG,k) + (x/w)IG.k-*- 1) 

T(x) = (1-x/w)T(j,k) + (x/w)Y(j.k + 1) 
At crossing point shown, x satisfies the aqua lo 
45 l(x) - T(x) = 0 i3 

Substituting and negating, the following aqua i 

. obtained: -r/' U: + 1)1 

[(x/w)-11[i(j.k)-T(j.k)] + (x/w) 

= 0 

so' Solving for x, ^\,x- 
(x/w) [IG,k)-TG.k) + ia.k-1)-TG.k+ 1)1 = 

G.k) 

and the solution Is k- -t- 1)1 

X = w[ia,k).TG.k)]/[lG.k).TG.k)-l0.k-^)-^^'^^^ 
55 The solution for x using this equation, ^^^^^^j^ 

equation achieving a similar result, is 
automated, implemented in a general P^''^*^ 
tal computer, but may also be impleme 
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other ways, such as through other types of com- 
pu^rs analog and/or digital circuitry, or combina- 
iions thereof. 

The above-mentioned threshold may in one 
preferred implemenation be determined as follows 
Wh.ie a f,xed threshold may be employed, i.e one 
whose values for all pixels in the image are equa! 
to a single constant value, this method, while useful 
n simple systems, suffers loss of accuracy owing 
o f,eld vanations in illumination source flux, and/or 

canneT^H-'" f different parts of the 
scanned subject, which in turn affects the interpola- 
.on accuracy adversely. This occurs because S- 
though the mask pattern may exhibit abrupt ac- 
cu^ ely defined boundaries between the ooaque 
and transparent areas, imperfect lenses and imper- 
feet focus effects, both in the projector and in the 
camera^ as wed as light diffraction and light disper! 
s.on effects ,n translucent subjects, causes the 
the" We?eJ° ^^"'^^^^^ ^^^^^^^ - blurred in 
evel causes vanation in the crossing point and 
hus v^,at,on in the solution for the boundary pos" 
Jon measurement. It is clear, then, that for best 
boundary measurement accuracy the threshold 
■Hhl ?H "^'^^^"^ " "^^^ ^^^'^ discovered that 
a conl'T f"" ' P"^^' '"^ to equai 

that wouTh °^ '"t-ns ity 

mask wet t? ^ Pattem-forming 

mask were transparent over its entire area without 
opaque areas as described for all other pTern 
^orm.ng .asks, then accurate boundary m^easu'^ 
ments are proauced. Thus, by imaging a fully- 
^lummated view of the subject, and multip y g 
each p,xel intensity in that Image by a constant 

ne haVr" '-^ thaVui^r ay 

can bf 'J'T ^^'"^^ °b*-'"^d that 

can be employed in the mensuration processing 

mentf !f ,r^:^;''""^ sub-pixel'mea u e- 

1" "'^"'^ ^'t*^'" the previously 

descnbed imaged views of the pattern-ilLinaTed 

Alternatively to imaging a separate fully-illumi- 
nated view, a full-illumination view can be s^n- 
thes,eed from the sequence of patterned views 

thatl'ch X v'^' r"" ^'^'^ -c^' 
east JnP I ' "9^*^'^ on at 

iluminl7 "Then the fully- 

eac^ ^^^^^^''^^-^ selecting It 

'mages in the sequence. 

Hi./*"^"! calculations, as well as the previously 
discussed image processing steps, can be imoS^ 
mente. i so«ware within a s^ultable compTr. 
thPv \9^"^^3l purpose digital computer or 
they may be implemented in a specialized com 
puter. analog or digital electronic hardware, or part- 



ly in hardware and partly in a computer, or other 
such means or combinations thereof as will be 
apparent to one skilled in the art. 

Alternatively, the boundary crossings can be 
s round through the use of secondary projected pat- 
terns, which have lighted areas corresponding to 
the primary pattern's dark areas, and vice versa, 
such that each pattern line position is represented 
in two complementary images, where if in one the 
'0 boundary crossing is from a light to a dark area 
then in the other the corresponding boundary 
crossing is from a dark to a light area, and vice 
versa. Then by comparing the pixel intensities, of 
the image observed when the secondary mask is 
'S projected, on a corresponding pixel basis with the 
pixel intensities of the image obsen/ed when the 
primary mask is projected, it is found that these 
pixel intensities along a scan line cross invalue as 
a boundary is crossed from a primarily light to dark 
20 region, the adjacent pixels thus straddling the 
crossing, i.e. lying to each side of the boundan/. 
and thus defining its position to lie between them. 
The same means of sub-pixel interpolation can be 
applied m this alternative to increase measurement 
25 resolution, by employing the difference of these 
two image intensities for lO.k) and setting the 
threshold Ta.k) to zero for all j and k. The main 
advantage of this alternative is that somewhat bet- 
ter boundary position measurement accuracy can 
30 in most cases be achieved than through the pre- 
viously described threshold method. The main dis- 
advantages are that additional patterns must be 
projected and additional images must be pro- 
cessed. 

35 While the preceding illustrations employ the 

concept of a "scan line" intersecting light-to-dark 
and dark-to-light boundaries, or profiles, in the im- 
age. It IS not necessary to use this construct in 
order to find the desired measurements. For exam- 
"0 pie. dispensing altogether with the concept of a 
scan line, a boundary itself may be traced along its 
length, finding a locus of points that define the 
curve of the boundary as it traverses the image. 
The only requirement is that, whatever means are 
^5 used, all or a desired part of the boundary, or 
profile, be measured with respect to the coordi- 
nates of the image, and expressed in a way so that 
rays in space can be found that both pass through 
the lens center and lie on the boundary in the 
image. 



50 



Continuing with the example illustrated in Fig. 5 
• and 6. in addition to locating and identifying each 
profile line found in the images with a three bit 
code, the pixel locations along each profile line 36 
and 36A are gathered and stored. These pixel 
locations are identifiable in relationship to the gen- 
eral overall coordinate system. With the obtained 
data and information, it is now possible to solve for 
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the three-dimensional spatial coordinates of the 
profile lines in the viev/ed images, to resample ihis 
data if desired to place it in the same or other 
coordinates on a uniformly spaced or other grid 
suitable for convenient representation, and to then 
create the output data file which is ultimately pro- 
vided to the user or to any further processing 
stages that may be needed for a particular applica- 
tion. 

To convert the two dimensional image plane to 
three-dimensional points in space in accordance 
with the present invention, data in the form of 
arrays of numbers corresponding to the pixel num- 
bers where a profile line or edge occurs in the 
image plane are required. This is done using the 
profile identification codes, with the scanline in 
which each particular point is found being math- 
ematically correlated with data defining the location 
of the projector and the viewing cameras relative to 
a predetermined general coordinate system. This 
takes into account. the pattern line spacing on the 
disc 18 and the focal lengths of the camera and 
projector lenses. The projector and camera coordi- 
nates relative to the system are obtained in both 
angular and linear translations. 

Because the position of the camera and the 
projector are fixed with respect to a reference 
coordinate system whose center is at point O. as 
shown in Fig. 1, it is possible to determine the 
location in space of any point such as the point A 
which is on one of the pattern lines 36 or 36A 
projected at the object by the projector 1 2. This is 
done, as aforesaid, by projecting different patterns 
at the object. 

Again by referring to Fig. 1, it can be shown 
that the location of a point, such as point A on the 
surface of the object, can be determined relative to 
the origin or center 0 of the reference coordinate 
system by solving mathematically for the intersec- 
tion of a surface of light created by the projection 
of any one of the pattern lines and a line created 
by the light reflected from any point where that 
surface of light intersects the object, such as point 
A, through the lens of the camera to the image 
plane of the camera. It should be noted that point A 
on the object corresponds to one of a continuum of 
points comprising one of the profile lines on the 
object. Physically the light rays from a given pat- 
tern line on the mask pattern are constrained to 
travel in a surface defined by the lens center of the 
projector and the pattern line on the pattern mask 
18. For example, when the pattern line is straight, 
this surface can be characterized by three points. 
The first is the projector lens center and the other 
two points are any hvo non-coincident points on the 
pattern line of the mask pattern. The light ray lying 
in that projected surface of light which causes point 
A to be illuminated on the sunace of the object is 



scattered therefrom creating secondary rays', some 
of which enter the camera lens therefrom and are 
viewed and recorded by the video or other type o 
camera and appear at a point, or essentially a 

5 point, on a raster, as previously described herein. 
From this raster it is possible to obtain the two- 
dimensional coordinates of each point of the re- 
corded image of each projected pattern line relative 
to the reference coordinate system. The ray of lign 

w 46 reflected from point A on the object passes 
through the lens center of the camera and strikes 
the image plane therein thereby resulting m the 
recorded image at that location. The light ray 46 is 
one of an infinite number of such rays which are so 

;5 reflected over different directions. If each individua 
ray of light is considered a line in space, the ray 
that passes through point A on the image plane o 
the camera and through the lens center ^ 
the projected pattern surface at point A on e 

20 surface of the object, and the coordinates ^^^^^^"^ 
the location of point A relative to the origin ot tn 
reference coordinate system is determined by 
intersection of this line and the identified projecte 
pattern surface. 

25 The same can be done for every point w"®^®^^ 

scan line crosses the various imaged profiles 
determine the three-dimensional shape of ^ 
ject along each profile line. Selecting how cio 
together the various projected pattern surfaces a 

30 Will then determine how much detail will be \n ^ 
resultant computed surface representation. It o y ^ 
few profiles are projected onto the object 2 
the detail will be coarse. On the other 
many pattern lines are projected, it will be P°^^J^^^^ 

35 to get much finer detail into the surface repres 
tion. It can therefore be seen that codes for 
ducing patterns 28 like those on the disc 18 or y- 
8 to meet the requirements described ^^^"^^^ 
are very important to the present ^"'^^^^'^"j^j.QQ. 

40 result of the above process is a set 
dimensional object points which can be 
they are but normally are resampled onto a uni 
grid, and may also be converted to be ^^^^^^^ 
in another coordinate system if necessary o 

45 particular application. nen- 
The object points described above are g^^_^ 
eralty unevenly distributed in the selected . 
nate system. Each object point has an ^ssoci 
X, Y. Z value, where X. Y. Z define the '0^^^'"^"^^. 

50 the point in the reference coordinate system 

fined earlier herein. If the X. Y plane is ^^^^^J"^^^ 
as the surface of a table, then the object P^'^^^^^j^ 
be described as spikes protruding from the 
By this analogy, the table surface. correspon ^ 
55 the X, Y, plane, and the spikes represent 

value at a particular X. Y point. The P^^"^®^^ ^ 
resampling interpolates the distance betwe^ ^^^^ 
values to create an array of points that ar 
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formly spaced in the X, Y plane. Now. if the surfac= 
's such that multiple values of Z occur at one or 
more X. points, then a coordinate system X' Y' 
c?n be defined that is rotated and/or othemise 
transformed with respect to the X. Y Z reference 
coordinate system, the rotation and/or trarisforma- 
tion chosen such that when the three-dimensional 
object points are expressed in this X' Y' Z' 
system then Z' is single-valued in X', Y' and so 
may be resampled as described. This is always 
physically possible for the three-dimensional object 
pomts computed from any one camera, because 
they are derived from single-valued imagery 

The completed uniform grid in a preferred em- 

fh°p T " "'^^'"^ ^Mlng every individual 
three-dimensional X Y Z ob/ect point one at a time. 
Because of the nature of the surfaces scanned 
Which are real objects, each point on the surface is 
positionally correlated with other points in the vi- 
cinity thereof. Based upon the nature of the surface 
Of the particular type of object, weighting values 

owJ^ '° '"''"Sice of an 

object point on the surrounding grid points based 

Z y V '"'^ '''^ ^' Y plane from 

Ition °' ol^iect point under consider- 

it = ^y®^2'^P«"g process proceeds recursive- 
ly as will be explained. 

If the density of computed three-dimensional X 

r:Jf,^°'"^^ °" '""^^^^ °^ o'^J'ect is suffi- 
ciently great, these weighting values need only 
approximate the true correlation of the surface. One 
possible weighting function that has been found to 
be satisfactory for a human head form representa- 
tion IS expressed by this formula- 

w = 1/(1 +cd)* 
where w is the weighting factor, d is the Euclidean 
distance between (he X'. Y< plane projection of the 
computed X'. Y'. Z'. three-dimensional object poi^' 

cons deration. and the constant, c. is a propor- 
tionality factor selected empirically so as to best 
mode the surface of the object. Further, when the 

cally derived minimum amount, m. then computa- 
Uon can be reduced, with only a small deleterious 
effect by not accounting for the influence of the 
object point on the grid point in such a case This 
's equivalent to account for the effects of this 
influence only where the distance, d. satisfies the 

c:i< {m-^''*-i)/c 
Two separate tallies are kept for each grid point 
one being the sum of the weighting values of the 
J component calculated for that gnd point as 
descnbed above, and the other the sum of the 
weighting values times the magnitude of the r 
values of the object points. 

After all points which were created by the 



profile lines have been placed on the grid and 
resampled, the running "sum of weighting values 
times the Z' values" is divided by the running 
"sum of the weighting values" to create a grid Z 
5 value that is the weighted average of all the object 
points that are within the above-defined Euclidean 
distance of the grid point. This information which 
may be in the form of a two-dimensional array, 
may then be sent to a post processor where the 
'0 resampled three-dimensional form information is 
Placed in the desired output form. 

The above description traces the data manipu- 
lation for a single camera, single projector system, 
'n a preferred embodiment six cameras and six 
'5 projectors are used to cover or substantially cover 
all sides of the object 24 to be reproduced. While 
SIX cameras and six projectors are preferred in one 
particular application, any number of cameras may 
in general be employed with the same or any other 
20 number of projectors within the contemplated 
scope of the invention, and in fact other numbers 
of cameras and projectors may be preferred for 
other applications, the objective being to adequate- 
ly sense the object's surface. Each projected pat- 
25 tern in the six camera, six projector system may be 
seen by all six cameras in general, but all six 
camera views need not be processed. For a par- 
ticular arrangement three of the six cameras are 
chosen as best positioned for each projection, and 
30 SO only three of the six available views are pro- 
cessed for each projector. Other choices may, of 
course, be made. Thus the above data manipula- 
tions are performed 18 times (once for each of 
three camera views processed for each of six pro- 
lectors). Because these eighteen surface segments 
overlap in space, it may also be desired necessary 
to combine them to ultimately obtain a single re- 
presentation of the surface. 

If. as would be the usual situation, each of 
<o these ^segments were resampled in a common X\ 
Y\ coordinate system, then the resampled 
points are comensurate among the surface seg- 
ments. If not, then they must be converted to a 
common system of coordinates if they are to be 
<5 combined. It should be noted that it is not always 
necessary that these segments be combined, since 
individual segments considered together form a full 
representation of the sensed surface, which may 
be satisfactory for an intended application. If it is 
50 desired to combine the segments into a common 
representation, then a preferred method is to ac- 
complish this during the above-described resam- 
pling process. The computed three-dimensional X, 
Y. Z object points of each segment are transferred 
55 if^necessary as described previously to a common 
^^ Z' coordinate system in which the resam- 
pling of all surface segments is to take place. 
Proceed them with the resampling process to a 
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uniform grid in the X\ plane of this coordinate 
system, as previously described, taking all object 
points of ail segments in turn to generate the 
combined resampled uniform array representing all 
of Che surface segments. This method required that 
the arrangement of projectors and cameras be 
such that it is possible to define an X\ Y\ Z' 
coordinate system that simultaneously satisfies, or 
satisfies as closely as necessary for practical pur- 
poses, the single-valued requirement in Z' for the 
resampling method described. One arrangement 
found to satisfy this requirement is that wherein the 
projectors and cameras are more or less evenly 
distributed on a whole or partial sphere about the 
scanned object and where the X\ Y\ T coordi- 
nate system is a spherical system centered or 
approximately centered within this array of projec- 
tors and cameras. 

Where the single-value requirement for the de- 
scribed resampling method is not met, then other 
methods of representation can be used. In one 
such method, commonly encountered in the field of 
computer aided design, a Cartesian, i.e. rectangu- 
lar. X\ Y\ V coordinate system is employed, 
wherein the surface is represented by contours 
defined by the intersection of selected planes with 
the computed surface. In this method, a computed 
X\ Y\ object point can be represented by 
projecting it onto the nearest cutting plane, or for 
greater precision local surface patches can be fit to 
the data, the surface patches themselves constitut- 
ing a combined-data representation, or the con- 
tours defined by the intersections of these surface 
patches with the above-described cutting planes 
can be employed as the representation. It is clear 
that there are many ways to implement the com- 
bination of computed three-dimensional surface 
segments, with preference of one method over 
another depending on the type of object scanned 
as well as the preferred form based on the particu- 
lar use to be made of the data. 

Figure 11 is a schematic circuit diagram show- 
ing one form of circuit 50 for use with the present 
device. In the circuit as shown there are provisions 
for six projectors 12A-12F and six video cameras 
14A-UF. The circuit can be modified in an obvious 
manner to accommodate other numbers of projec- 
tors and/or cameras. The projectors are controlled 
by a timing and control unit 52 of a video acquisi- 
tion unit (VAU) 54. The timing and control unit 52 
has a connection to each projector and is used to 
predeterminately synchronize pattern position and 
control the strobing of the light sources 30 in the 
projectors 12A-12F in a time ordered fashion and 
to synchronize the strobing with the imaging by the 
cameras 14A-14F. Each time a projector is strobed 
the video camera or cameras that are in position to 
see the light projected by that projector have pro- 



files formed on their image rasters m the m 
described above. The outputs of the video carne 
14A-14F are then fed into respective video acqu 
tion modules 56A-56C. in this example one s 
5 module being provided for each two video cam 
14 since as already discussed for the exarnw^^ 
shown only three cameras need be 
any one time. These modules digitize the inKDrm^^ 
tion received by the cameras and ^^^'^Jr^^^g 
70 formation in Random Access Memories, i 

thus stored is thereafter fed to a Host ComP^^^^ 
unit 58 which processes the data to .^^^ 
three-dimensional surface information as ae ^^^^^ 
previously herein, and reformulates it 
;5 form such as recording it on a pnnter 60^ teea ^y^^ 
to a video terminal 62, or generating a rioppy 
64. It is to be understood, however, ^^y" 
quence in which the projectors are strobed 
which the cameras store the data P^^^uced during 
20 the strobing is not important as long as a 
data that is projected onto the image, ^i^^" ^ 
the profile lines, are viewed by the corra ponc^nQ 
cameras in a known order and a recor 
thereof. For example, the projector U A c v^^^ 
25 duce an image which may be viewed 

camera 14A and the outputs of the ""^"^^'^ to 
then fed through a multiplexer 66 for conv 
digital form in an analog to digital converter 
allocated through demultiplexing ^"'^ J/ . 75 for 
30 three Random Access fvlemories 72, 74 

later use in the manner indicated above. \ ^^^^^ 
more than one memory module, such a ^^^^^^^ 
shown in this example, allows the use 0^^^^ ^^^^ 
less expensive memory modules, as tne ^^^^ .^^ 
35 at each output of the demultiplexer is lowe 

input data rate by a corresponding ^ disc 

Referring to Fig. 8 there is shown a ro 
member 18 for use in the projectors p^t- 
present device. Alternatively, linear ^ to 

40 terns can be employed, as is most con ^.^^ 
the particular projection means selectea ^^^^^ 
member 18 is shown having the ^^nular ^^^^^^^^ 
area 28 formed thereon near the ^^''^^^J^..^^ into 
and the encoded area 28 is shown c^vic ^^^^^^ 
45 eight equal length segments 28A-28H ea ^^^^^ 
by a plurality of light and dark pat- 
Segments 28A-28B represesnt four ^'^^^^^ ^^^^^ 
terns, and 28E-28H their complements. 
tions and widths of the light and dark regi ^^^^ 
50 four patterns are different according to ^ 

will be explained in connection with itioned 
so that regardless of which segment P ^ a 
between the light source and the lens sy ^^^^^^^y 
particular projector, the image P^°»®^^® areas, 
55 will be a series of elongated light ano ^^^^ ^^^^^ 
but no two arrangements of light and ^^^^ 
need be the same for any two ssgrr^©"^^ 
of the pattern lines formed by and t^eiw 
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nvo hght and dark areas in different patterns will fall 
on the Object 24 at the sarr^e location, except tha 
-th the optional use of the complementary oal 
terns as shown here, each profile line wilUh.s 
appear at the same position in hvo segments, ha 

; at oaZT*' '"!!""^ Pr-maryUern With 
that panem l.nes and its complement. This is im- 

2S0 will form profiles on the object when projected 
hereon Which will have edges or profile Jnes ha 
fall exactly on the same spot or location on the 

orS linf '°"tion'o 
profile lines for each pattern is a very important 

advantage to the present invention Lau'a no 

low in r '''''''' a'- 

lowing for more total distinct profiles among all the 

the three-dimensional surface representation 

As shown jn the embodiment of Fig 8 the 

Inrlfn T^""""*' determined and 

iect profile °^ ^^^^^^ -'^'^ P- 

orofiif ? , ' °" ^ ^'"^"^ such that 

profile lines formed by adjacent transparent and 

one of many possible pattems that share the de! 
tdbution°nr''' S-'^h a dis- 

the St. P. ''"^'"^ ^° ^""^ 92 that meet 

Tariet? S ^^"^"'^^"^^"ts can be determined in a 

a»hn.?nh l-"""""^'^' '"'"''^'■"9 and error 

although this IS very difficult to do as the number of 
areasjo and 82 and the number of pattems in 

In the disc construction shown in Fig. 8 the 
coding of the segments 28E.28II are the binar^ 
complements of the coding of the segments 28a^ 
28D respectively. Although binary complements 
are not required to achieve the objective of the 
present device, they are utilized in some em odi^ 
men s to assist in more accurately locating the 
prof e ,.nes ,n the viewed image of the object 24 
as a^eady described. A novel method for tilizing 
What fSr"'^^ ^'---sed i^ 

scribln """^ previously de- 

12F andT """^ P^°''^'^*°^s '2A. 

in Fin n ! """^^ ""^'^'^ '^^-''^ - shown 

which to 1 '° f^O'n 

po ntsorloSf " '''' "^'^'"P"'^'^ '"^'^'-d"-' • 
and 'P''^^ '° ^^P^^sent the shape 

and 0 our of the object 24. Thus it is possible by 
accurately locating the pattern lines on the disc 18 
and by using projectors and cameras located as 
Shown to achieve results heretofore unobtainab e 
above '""'"''"9 ^'^'^'^ssed 

which the data is stored is. of secondary impor- 



tance to the basic principles of the present inven- 
tion which can best be understood, as already 
explained, by considering a single projector ca- 
pable of projecting succeeding but different light 
5 pattens onto a subject, and of video cameras lo- 
cated to record what they see of these projected 
patterns , and the ability to use the data so re- 
ceived to feed into electronic circuitry capable of 
storing and processing the data to produce outputs 
'0 representing the surface shape of the subject 
which can then be used for controlling the opera- 
tion of a machine such as a replicator machine or 
for some other purpose. 

The patterned disc 18 is normally rotated at 
'5 some desired speed during operation of the device 
10 with the rotation motor controlled by synchroniz- 
ing circuitry so that the angular position of the 
patterned disc at any point in time can be ac- 
curately determined. Normally, the disc rotates 
20 continuously, but altematively it could be stepped 
from pattern segment to pattern segment as de- 
sired. The rotation of the disc and the timing of the 
strobing of the projectors is extremely important to 
the present invention and are controlled by the 
25 controller unit 52 (Hg. ii) which may include a 
microprocessor or other suitble circuitry. Ml of the 
projectors are similarly strobed in a predetermined 
sequence and the patterns projected onto the sub- 
ject are viewed by certain one or more of the 
30 cameras, and the information obtained processed 
and/or stored for later use. The projections need 
not be strobed in any particular order, nor need the 
pattern segments be placed on the disc 18 in any 
specific sequence so long as each processed im- 
35 age can be associated with the pattern that gen- 
erated It. Pattern projection by means of a synchor- 
nized rotating disk as described here is only one of 
many possible means of projecting different pat- 
terns onto the subject. Other means might be by 
"0 using a filmstrip projector, a slide projector, a sin- 
gle mechanically or electronically alterable mask, 
simultaneous projection and separation employing 
different colors and/or polarizations for each pat- 
tern, and so forth. All such projection means are 
"S within the scope of the present invention. With the 
present system as described, very fast and effi- 
cient sequencing of the segment patterns is possi- 
ble, normally limited only by the maximum frame 
rate of available video cameras. 
50 The projected patterns,' though arcuate in 
shape as illustrated in Fig. 8, could alternatively be 
other%vise shaped, such as straight lines over the 
areas of use. provided that, whatever shape is 
chosen it is properly accounted in subsequent pre- 
ss cessing. The arcuate shape is chosen for the il- 
lustration because it is more tolerant of angular 
position uncertainty than are other shapes, thus 
easing the tolerances on the aforementioned syn- 
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chronization behveen the rotation of the pattern eluded to detect any faulty memory °P®^^"° g I 

disc and the reference timing of the control unit. It this feature the computer writes known pa ^^^^ j 

is also contemplated to place a second light source into the memories, and then reads the aaia | 

an associated second projection lens assembly at checking to verify its accuracy. ^^^^ . 

another location on each projector. The second s The location and widths of the ? 

light source would be strobed on a different time make up the bar patterns of the four prima / ^ 

schedule and, for example, if located 90* from the ments 28A-28D on the disc shown '"J^'^' j,^g. 

first light source would project patterns at an ori- preferably determined in accordance with a y ■ ^ 

entation 90 ' relative to those of the first light sis method developed by the inventor. This sy^^^^,_ ^ 

source. By projecting patterns with their profile lo sis method is important to the invention an ^^^^^ ^ 

lines oriented at different angles, whether by this or nates to a large extent tedious trial and 1 

another method, and viewed by cameras from the ods associated with designing the bar pa ^^^^^^ 

same or different positions, additional data can be the mask segments. There remain many P 

obtained and processed to achieve even better bar patterns meeting the aforesaid requireme , 

resultant three-dimensional representation accuracy ts which the creation of one is shown > 

than could be obtained if all of the profiles are shows an efficient method for generating ^^^^^ j 

oriented the same. This benefit is achieved in the other possible similar patterns. It is the ^ _^ 

example by using a single projector having two patterns meeting the aforesaid critena t a ^ 

spaced light sources and associated lens assem- invention, not only the one pattern 

blies but with a single rotating disc 1 3. although 20 specifics of designing the four primary 

any other method of achieving the same effect is Fig. 8 can best be understood by ^ gg. 

comtemplated within the scope of the invention. In code used to create the segments. gSD^of 

the usual situation, the two pattern orientations quence for producing the segments ^° 

would be chosen to be 90' apart which produces Rg. 8 Is shown in Fig. 9 wherein a seq 

the greatest difference for the patterns shown and 2s numbers from 1-158 correspond ^j^th 

which is easy to achieve using the same disc. arbitrarily determined units, with the ra ^^^^ 

Such a projector is disclosed in co-pending patent along section line 9-9 of the individual m ^^^^^ 

application Serial No. of the present inventor. ment 28A of Hg. 8. For a second examp ^^^^ 

In operation, initially the present light sources the bars are straight rather than cjrvea, ^^^^^ ^ 

30 are strobed under control of the Timing and 30 responding measure would be the *^'^!f^Vj,gss of 

Control unit 52 in Video Acquisition Unit 54 (VAU) line crossing the bars, and so jtioning 

in a predetermined sequence, synchronized with the pattern arrangement, however, the p 

the video camera frame interval. At any given time, of the bars and their widths is '^9^®''"''"®° ^j^jth of 

only three of the six cameras 14A-14F are used in as described. The code as shown and g of 

the particular configuration illustrated, which means 35 the segment 28A. as shown are for p v^^^ 

that only three camera input channels are required illustration since a different code can °° 

in the VAU. one of each pair of cameras being the code length could be a greater or p^es 

switched onto a aiven channel at any one video ber than 158 as long as the o^^^^" !^ g^eas of 

"frame" timed. In a typical operation, the cameras with the stated criteria for light and da 

produce data at a rate of approximately 7.2 million 40 the pattern employed. Furthermore, tn gtiern 

"pixels" per second (MHz), whereas normal rela- each primary segment 28A-2aD of f,orizon- 

tively inexpensive computer memory integrated cir- shown in Fig. 8 corresponds to °^ ^ Rg- 

cuits (l.C.s) can not operate at that rate. In order to tal rows of binary 1's and O's as '""^JJ prefac- 

make use of the less expensive memory integrated 9. Each of these four rows of 1's and u^^ ^^^^ 

circuits, each channel is shown having three mem- ts ed by an identifying number from - ^^^^ 

ory sections, each operating at one-third the cam- binary 1 is considered a dark positio ^^^^ 

era's pixel rate, or at approximately 2.4 MHz. This binary 0 a light position it can be sho^ ju^strates 

is accomplished by sequencing the video signals horizontal row labeled 1 at the left ®" the 

among the three memories 72,74 and 76, each in numerically the widths and transparen 

turn, such that each memory 72. 74 and 76 need so bars along section line 9-9 of segme ^^^^g^i^s 

operate at only one-third of the rate of the video similar correspondence can be shown labeled 

input thereto. When these memories are later 'read' 28B, 28C and 28D of Rg. 8 with the ro^^^^ ^.^ ; 

by the computer, they are sequenced in such a 2. 3, 4 respectively in Fig. 9. The sequ g^arn- 

way as to recreate the order of the original input and O's illustrates that on segment ^^^^^ ^. ^^.^ 

data stream. While the factor-of-lhree rate reduc- S5 pie, the pattern begins with a black se ^^^^.^^^ 

tion is illustrated, any other can also be used, the width 1. then has a clear or ^''^^spa'"®^^.^^ ^nit 

optimum factor depending on the specific applica- unit width 3. followed by ^ ' ^ f^-ient 28A 

tion. A memory-test feature may optionally be in- width 5. This code can be related to 9 
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throughout the width of the seament ' 
Fio l^^i '^"9^h"'°"g code string of 

subl^~ ''''^'■"''"^ ^"''P^tterns. These 

subpctterns vary in length based on the code de! 
s gn cntena yet to be detailed. For purposes of = 
•' ustrat.on. the subpattern between uni^ in 

tern n?,H T"''"'' '''' °^ reference tubp 
tern or the total code string. Also shown in Rg TL 
a sequence of numbers ranging from 1-4. There s 
one Of these number under each unit loca on ,o 
These numbers dictate which mask pattern sen.' 

"ght orl-ohtTw 7 "'^ °' 0 
location f ^'"^ length 

there is the transition Number 1 which indicates 
that when moving from location Number l to "ca 

^gmeri'it'--^ T'^^ "'"^ " 

S created .V '^^^ ^^^^ 

-vhich created this line is from dark to light. Similar 

-adings can be made at the other 157 locatfons fn 

This 158 unit may be determined by first find- 
ing a shorter sub-pattem code such as ^hThT 
sub-pattem discussed earlier, that obeyf 

terns'Tori complementing the pi- 

terns to produce in the example case up to 16 

ogether. The requirements that are imposed on 
he base sub-pattem to enable it to gZate th" 
larger patterns of Fig. s are as follows- 

"^l^® sub-pattem must define a measure of '° 
d sp^cement along the mask sub-patterns with 
width increments, typically equal, such tha one 

o - transition at e ch 

of these displacement increments 

Oi) The sub-pattem is required to be cvclic 

or ann ^ transitions should be uniformly 

ZurT'T"'' r^'''^^' "'^''^^^^'^ among The 
cur pnmary mask pattern segments. This implies 

lameT h''"'^" '^^^ °r nea ^ he 

same number of edge transitions 

of ^""""'^ °' ^®«°l"«cn capabilities " 

t ansln. S"^ "° ^c edge 

be closer thT " ^^^c'd 
De closer than a selected minimum number of unit 

locations. Based upon analysis of one poss.ble 
«on sh' h'k°''"' '^^'S"- '^''^ "Minimum Teo"^ 
m ose j ^PP""«cns may 

oaSero w Since, within a g.Ve^ 

positive and negative directions (dark and light 



-(■ess), this implies that the minimum width of ei- 
ther a 'black' or 'white' (opaque or transparent) bar 
or area must be three units. 

(V) With four patterns, as chosen here (more 
or less could be used if the dictates of a particular 
system should so require), up to 54 unique profile 
lines can be defined (located and identified) by 
knowing only 

(a) which of the four projected patterns 
corresponds to the observed image, 

(b) the direction of the edge (dark to ligfit 
or light to dark), and 

(c) the intensity state (light or dark) of the 
remaining three patterns at that positions in the 
•mage. 

Using only these identifiers, it is possible to 
produce 4 X 2 X 23 =64 unique codes, that is, the 
pattern number produces a factor of four, the edge 
direction a factor of two, and the remaining-pattem 
intensity states another three factors of two, in all 
64 unique possibilities that can be resolved by 
observing the four pattems at a given position and 
evaluating 64 unique possibilities that can be re- 
so ved by Observing only these identifiers. Simi- 
larly, by examining the four images corresponding 
to these four projected patterns, up to 64 edges, or 
profiles, can be uniquely identified. If it is desired 
to define more than 64 uniquely identifiable edge 
transitions, without increasing the number of pat- 
terns beyond four (determined from other design 
considerations), this can be done by using the 
sequence of pattern numbers as another identifier, 
for example by observing which of the remaining 
three images has the preceding profile to the left. 
The code can be further extended by observing 
which of the then remaining 2 patterns has the next 
profile to the right. This can be extended to addi- 
tional neighboring profiles, but utilizing only the left 
and right neighbors as illustrated would increase 
the number of identifiable edges by up to a nnaxi- 
mum factor of 6. or 384 total edges, although the 
actual maximum number is less because of the 
other imposed restrictions. In most cases, it should 
be possible to identify as many profiles as there 
are unit locations. For resolution requirements in 
accordance with the example system, there are 
158 uniquely identifiable profiles. 

As a consequence of the imposed require- 
ments, the sequence of digits declaring the pattern 
numbers (1-4) of the sequence of pattern lines, one 
such line perat each increment of displacement, 
must not duplicate any substring of three digits 
within the length of a cyclic sub-pattern. If it did, 
then the identifying parameters described above 
may repeat for that three-digit sequence in another 
Of the up to 16 complementary sub-patterns, de- 
stroying the uniqueness requirement. 

Since no two profile lines are permitted at the 
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same unit displacement location, if i\vo or more 
edges are detected in a viewed image at the same 
position (e.g. within an allowable tolerance of. say 
+ one-half pixel, or other value that may be 
chosen), then this is an error condition and that 5 
edge is tagged as not uniquely identified. This can 
occur in practice, for example, at a step-off on the 
scanned object, creating a "fold" in the sequence. 
Additional logic may be employed to 'rescue' some 
or ail of such non-unique profile declarations, by w 
testing the several possible identifications to see 
whether one of them places the profile in sequence 
with previously identified profiles, rejecting iden- 
tifications that place it out of sequence. 

As stated, no three-digit substring may repeat /5 
itself within any sub-pattern as shown in Rg. 9. 
Further, within a three-digit substring, no digit can 
repeat, because of the aforestated requirements 
that profiles cannot repeat within a pattern within a 
three-unit separation. Thus, in a three-digit se- 
quence, the first digit may be selected freely from 
among the four patterns, the second from the re- 
maining three, and the third from the remaining 
two. Since there are, therefore, 4 x 3 x 2 = 24 
unique three-digit substrings, 24 is the upper- 
bound on the length of a sub-pattern under the 
conditions chosen for this example. This length (as 
well as lengths 8 and 16) satisfies the preceding 
requirements that permit generation of cyclic 
codes, i.e., equal even-numbered edge transitions 
and uniform edge distribution among the four pat- 
terns. In Fig. 9, the four-digit binary number shown 
below each substring indicates which row or rows 
of the code is complemented so as to produce a 
substring code unique from all the rest. The sub- 
pattern 14-29, labeled 0000, is the reference, i.e. 
uncomplemented. Roms of the subpatterns are 
complemented where 1's are shown, the subpat- 
terns then cycled and truncated if necessary to link 
together with other differently-complemented sub- 
patterns while retaining conformance with aforestat- 
ed criteria throughout, i.e. both within each subpat- 

tern and across the links between them. 

The code of Fig. 9 is displayed in Fig. 10 

sorted by the pattern number (1-4) and pattern 

code, which comprise the aforesaid 6-bit codes 

capable of uniquely identifying up to 64 profiles. 

Each member of the 6-bit code has associated with 

it in this example from one through four possible 

profile numbers, or distance units, as listed in Fig. 

10. These up-to-four possible identifications are 

then resolved by the aforesaid means of examining 

the neighboring profiles and/or assigning them in 

sequence. 

Fig. lOA is again the pattern of Fig. 9, wherein 
the profile numbers are sorted by the aforemen- 
tioned three-digit pattern number sequences. In 

this example, there are as many as eleven possible opaque areas, 
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profile identifications for given three-oigi^ 
quences, resolved by using the aforesaid rematni g 

identifiers. , ^ 

To reduce the number of possible profiles ror^^ 
given 6-bit code, to make it easier to resolve 
correct profile using the remaining identmers, i 
possible as illustrated in Rg. 10 and f^^^^^'^^^J^ 
above, to require no more than four rep 
throughout the overall concatenated pattern o a^y 
of the basic 64 (see requirement v) codes, 
restriction reduces the upper bound of the 
number of unique pattern boundary lines from 
to four times 64 or 256. and may also 
actual maximum number in the face of the ^^^^ 
properties. However, by selecting a sub-pa 
length of 16. rather than the maximum of 
previously discussed, and applying the ^^^^^ ^ 
quirements. it will be possible to assure ^^^^^ 
than four repeats since there are no more tna 
repeats of each of the 4 digits in a 
pattern, all within unique three-digit ^^'^^V 
the sub-pattern, and upon generating the max ^ 
of 16 complementary sub-patterns a ^^^'^"^^ ^^^r 
repeats per digit therefore will f^e*^®^^^''^^:,ariv 
within the above-described 6-bit code. Sim 
use of a 24 long sub-pattern would P^'^ 
repeats throughout the up to 16 compiemeni y 
sub-patterns, since each of the 4 digits is repe 
six times within a 24 long sub-pattern. 

Once the profile line positions have ^^^^ 
sured, or mensurated in the viewed [^^^^^^^^^^ 
described in the preceding paragraphs, it is ^^^^^.^ 
ary to identify the profiles. As discussed, a ^^^^^ 
code is made up consisting of the patte 
tification. the direction of the. profile ^ 
positive pattern, which is immediately ^"^^V^^^^^^ 
result mensuration process (already 32 
and the intensity state (0 or1) of the remaininy 
patterns at the pixel position of the said P'°^* '^^^^e 
The stated requirements were used to g ^^^^ 
a cyclic 16-bit long sub-pattern, which 
plemented as discussed by exclusive ^ 
XORing it with a 4 bit code value a n^m ^^^^ 
times, and merged to create the 1 58 bit long 
shown in Fig. 9. c:\q 9 

The variable width bar pattern shown ^^^.^^^^^3 
is an example of one of many possible ^ 
which can be used to design the widths ot ^^^^ 
dark sections of a mask pattern. ^"^'^ ^^gigp 
code was developed in accordance witn 
criteria set forth herein using the subpa 
tween locations 14-29 inclusive as a tDa _^ern 
binary I's indicate dark locations on a ^^.^ely. 
and binary O's indicate light locations. A^te ^ 
this designation could be reversed. W * ^.^^ci 
lustration is in terms of generating the P^^^ 
spatial patterns via a projection mask o ^^^^yjce 
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Potterns m space according to these cirteria are 
contemplated as well. This 16 bit code subpatte n 
stnc ly adheres to each of the five criterial require- 
ments set forth above. The base code subpattern is 
arbitranly assigned the check code 0000 the pu ! 
pose Of which will be detailed in what follows Z 
sequences of Vs and O's in the code subpatte m 
are not themselves unique. Although each 
mask pattern sequence of Vs and O's meefs the 5 
enter., requirea,ents. each has a different!! 

To ensure that the criteria/ requirements are 

sat,sr.ed at the boundries between any two stbpat! 
terns , ^^^^^^^^^ ^^^J^^ s^bpat 

base code about itself when developing each of he 

TV" " "^'^^ convenient by per! 
m-ttmg the base code to be shortened in addiSon 
to bemg rotated. Referring to the subpattern be- 

can be 3hown ,n Fig. 9 that this code subpatter 
s arts ,ts sequence with the second half or last 
erght bits Of the base subpattern code and then 
continues with the first eight bits or first half of 'he 

subna^l ""'^"^"^^^ °f ^" ^'^bsequent 

Check cod2 "" be Checked by determining a 
Check code wh.ch when exclusively OR'd with the 
base code subpattern. at like locations in the base 
code subpattern and subpattern to be checked 

the blf ^oH^ "'^'"^P'"- ^hown that in 

the base code, a pattern sequence can arbitrarily 
be designated to start at location 17. This pattern 

reads 1 23421 4'^pi'^9a ^ • "ii^ panern 

continues wi h i i r^ ^^"^ 
oniinues with 134. This same sequence can ho 

defined as starting at location 39 and goTn, I 

location 45 and then continuing at locatln 30 and 

s.ve. This subpattern string was rotated or cycled 
to maintain the subpattern criterial requirements 
the intersection of the two subpatterns. To c eck 
the uniqueness of this subpattern with respect to aS 
previously determined subpattern. identS pos 
^ons in the base subpattern and the subpattern to 
be Checked are located, e.g. location 1 7 co re- 
sponds to location 39. A four bit check code is t en 
determined. This check code, when XOR'd with the 
'"dividual four bit code, read vertically, which cor 
espon,3 to patterns 1-4 at the idem ied starling 

ern Bv c^^ed-subpat' 
tern. By way of example, the second check code is 

OR (XOR) with the four bit code 0011 found at 
location 17 which when XOR'd results in the 1 
b.t code 1010 at location 39. This code was de^e^ 
m.ned to be 1001. To continue verification of he ' 
uniqueness of the second subpattern and to che k 
the accuracy of the check code, this same check 
code when XOR'd with the four bit c^de 01 11 



found at location 18 should result in the four bit 
code 1110 found at location 40. It does. This one- 
to-one comparison is made with each pattern code 
at locations 14-29 inclusive with its corresponding 
5 location between 30-45 inclusive. 

As shown in Fig. 9 some subpatterns have less 
than 16 locations. For example the first subpattern 
locations 1-13. has only 13 .locations. It can be 
shown that substring 132 (at positions 26-28) within 
'0 the base subpattern has been removed in order to 
maintain the first subpattem's compliance with the 
cntenal requirements. The uniqueness of the sub- 
pattern is also proven by determination of a four bit 
check code in the same manner in which check 
'5 code 1001 was determined. For this subpattern the 
code 1111 is determined. This sequence of steps 
IS repeated until a 158 bit long code comprised in 
this example of 11 of the 16 possible subpatterns 
<s created and checked. Each subpattern has its 
• 20 own unique check code. 

As detailed earlier herein the 158 length pat- 
tern is for designing the variable widths of the dark 
and light sections on the individual disc patterns. 
This code also can be read to determine which of 
25 the four patterns has a pattern line at any give" 
location 1-158. Referring again to Fig. 9. the top 
horizontal row of number 1-158 indicates location 
points spanning the width of each of the four pri- 
mary coded patterns in segments 28A-2SD. The 
30 first vertical column of numbers 1-4, indicates 
which disc pattern is being examined. The second 
honzontal row of numbers, which vary in a deter- 
mined sequence between numbers 1-4. indicates 
vvhich of the four coded mask patterns had a 
35 boundary line at that given location. For example, 
at location 2 along the top horizontal row. the upper 
bit number in that vertical column is a 1 , indicating 
that when moving from the previous location, loca- 
^on 1, a state change occurs in mask pattern 1- 
fo This can be more particularly pointed out by exam- 
ining Fig. 9 where it is shown that pattern 1. 
between locations 1 and 2, changed state from 
dark (1) to light (0) while that of the other three 
patterns remained dark as shown by 1 's at both 
"^s locations. 

To identify a profile in a system using the four 
mask patterns corresponding to the design code of 
Fig. 9, first and second solution charts of Fig-S 
and J OA are utilized. In the first solution chart, the 
so 16 "1" numbers in the first column corresponding 
exactly to all the first pattern state changes In the 
design code. Each of these number 1 is followed 
by a the four bit code which indicates the direction 
. °^ change for the pattern containing the 

00 boundary line, here the first, and of the remaining 
three patterns which patterns are dark or light at 
that same location in the design code. Following 
'he four bit code are the location numbers in the 
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design code in which changes in ihe first mask 
pattern occur. These location numbers correspond 
to the location of a boundary line, here those in 
coded mask pattern number 1. As is shown in Fig. 
10 each code can identify up to four different 
profile line locations. To determine uniquely which 
one of the four possible profile lines was observed 
in an image, the following spaces of steps is per- 
formed assuming the code 30001 has been iden- 
tified. Rrst, the computer or other processing de- 
vice scans or reads the 30001 line and determines 
that this code can identify profile lines occurring in 
pattern 3 at locations 52, 60, 68, 114 in the design 
code of Fig. 10. It is thus learned that the profile 
line is located in projected pattern 3 as established 
by the code and can be one of these four different 
"profile lines. To locate and identify the exact profile 
line, it is noted which pattern number has the 
neighboring profile to the left, and which to .the 
right. These three pattern numbers, i.e. the one to 
the left, the one containing the given profile, and 
the one to the right, form a three-digit sequence 
that, together with the aforementioned six-bit code, 
is unique within the 158 long pattern and thus 
.uniquely identifies the given profile number. To 
continue the example, the profile to the left of 
profile 52 is number 51. which with reference to 
Fig. 9 occurs in pattern mask number 1. Similarly, 
the profile to the right, number 53^ occurs in mask 
2. Thus the three-digit sequence is 132, which, with 
reference to Fig. 10A. occurs at profiles 27," 33, 52, 
71. 77. 96. 110. 129, and 154. Comparing this list 
with that given above based on the aforementioned 
six-bit code, i.e. profiles 52, 60, 68 and 114, only 
profile 52 appears in both lists. 

Thus the profile at location 52 is the one which 
was observed, and so the projected light surface 
that produced this profile is found.. This procedure 
is repeated until all profile lines visible in the image 
have been uniquely identified. As discussed earlier 
herein the pixel locations are also gathered and 
stored for each identifying code. The codes in the 
solution table are referred to as six bit codes be- 
cause in the actual implementation of the scanner a 
two bit code is used to identify which coded mask 
pattern is being scanned. For example, pattern one 
is identified by 00 and patterns 2-4 by codes 01. 
10 and 11, respectively. 

It is desired that the imaging by photographic 
or video means take place only during the time the 
projector lights are being strobed and therefore are 
projecting patterns onto the object. By synchroniz- 
ing the projection and imaging to occur 'simulta- 
neously, assurance is obtained that the selected 
predetermined patterns are imaged. 

When determining the six bit codes for the 
embodiment wherein four mask patterns are used, 
four separate images, and thus four separate ras- 



ters v/ill be developed, each having up to approxi- 
mately 40 profile lines thereon. In each of the the 
viewed image rasters, the matrix pixel locations oi 
viewed profile lines must be associated v/ith the 
5 profile with the profile identification locations m 
Figs 1 and 2, for example. For any given size of 
the matrix, is chosen arbitrarily, a particular math- 
ematical relation exist that can be utilized to 
achieve this correspondence. 
70 Upon initiation of such an overall system, the 

■ strobing controls for the projectors and cameras 
are triggered by means such as the Timing and 
Control portion 52 of the VAU 54 in a predeter- 
mined sequence. In this example each projector 
/5 has two separate light sources to project patterns 
in two different ways Each of the six or so projec- 
tors has each of its light sources strobed four times 
in one embodiment, once for each of four segment 
patterns 28A-28D on the disc 18, for a total of 48 
20 flashes. In another embodiment, the two light sour- 
ces in each of the six projectors are each strobed 
eight times, once for each of the eight segment 
pattems 28A-28H. for a total of 96 flashes. The first 
embodiment is used with the aforesaid means of 
25 processing that compares image pixels against a 
threshold number so as to assign them to either 
the dark or light portion of the pattern, and the 
second embodiment is used with the aforesaid 
means in which the corresponding ennbodimeni is 
30 used with the aforesaid means in which the cor- 
responding pixel values of two images of com- 
plementary patterns are compared so as to make 
that same determination The video signals from the 
six cameras are in this example digitized at eight 
35 bits (or one byte) per "pixel", and stored in Ban- 
dom Access Memories (RAMs) in the VAU. Other 
representative digitizations might be more or less 
than eight bits but typically In the range of 4 to 10 
bits. In this case, two strobes are flashed at once, 
40 on opposite sides of the subject, such that any one 
point on the subject is illuminated by only 
the two flashes, although they could also be 
flashed at separate times as well. For each double 
strobe flash three camera views are digitize^^- s 
45 total of 72 images in the first implementation, or 
144 in the second, each image raster here havmg 
approximately 256 x 256 or 65.536 pixels, although 
other raster sizes may better suit other applica- 
tions. Once the image data is in the VAU memory. 
50 the host computer reads it from the VAU memory, 
in this example through an eight-bit parallel port, 
and stores it on a hard disc, from which it >s 
accessed by a central processor for further pro- 
cessing. Alternatively, the data may be stored in 
55 other ways, or it may be processed directly without 
requiring storage. 

As stated herein six projectors and six cameras 



are employed in the described application. 
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purposes of illustration, three of the projectors may 
be arranged in a horizontal equilateral triangle 
aoove the subject, which may be a person's head 
and the remaining three on an equilateral triangle 
below the object, such that each of the upper 
projectors labeled for example U12A. U125 and 
U12C, has diametrically-opposed to it one of the 
lower projectors labeled for example L12D LT2E 
and L12F. Projectors U12A and L12D are then in 
opposite directions from the subject and so may be 
flashed simultaneously if desired without interfer- 
ence. 

There are eight possible camera positions con- 
sistent with the symmetry of the geometrical con- 
iguration described, four upper positions labeled 
U14A through U140. and four lower positions label- 
ed L14E through L14H. Positions U14D (directly 
above the subject) and L14H (directly below) are 
not usually used for portrait sculpture applications 
although the additional upper camera may be used 
If desired. All camera positions including L14D and 
L14H and all projector positions, may also be used 
in different configurations for other scanning ap- 
plications. When a given projector is strobed, par- 
ticular camera positions are more favorably located 
to see the illumination on the object than others* 
thus, not all cameras need be digitized for every 
strob© of a light source or every frame of the 
camera. 

The raster scans of all cameras are normally 
synchronized together so that at any given point in 
time ail active cameras are scanning the same 
ptxel number or are at the same point in retrace 
While not essential, this synchomization facilitates 
timing and control and data acquisition. Projector 
lights are flashed during the common vertical re- 
trace interval, so that new images are produced on 
tlie camera's photosensor arrays at the same time 
These images are then raster-scanned by the cam- 
eras and digitized. 

From what has been said hereinbefore, it will 
be appreciated that numerous variations, uses and 
applications of the present invention exist or may 
hereinafter become known, some few of which vari- 
ations, uses, and applications that can be foreseen 
and anticipated have been briefly discussed 
hereinabove and are mentioned herein by way of 
example only and not of limitation. All such vari- 
ations, uses, and applications, whether or not dis- 
cussed hereinabove, are considered to be within 
the scope of the present invention, which is limited 
only by the claims which follow. 



Claims 

1- A system for creating data to represent a 
three-dimensional surface shape comprising 
5 means projecting on the sunace shape 

distinctive patterns made up 'of pattern portions 
having distinctively different optical qualities ca- 
pable of being sensed, the patterns containing de* 
tectable linear features positionally located accord- 
ed ing to a code such that the positions of the lines in 
the different patterns are located at different dis- 
tinct locations therein; 

image sensor means positioned at a spaced 
location from the surface shape in postion to ob- 
75 serve the distinctive projected patterns on the sur- 
face shape, said sensor means including means for 
producing representations of selected ones of the 
distinctive pattern portions, and 

means for processing at least two image 
20 representations of projected patterns sensed by the 
sensor means, said processing means containing 
processing data representative of the relative posi- 
tions in space projection means and the image 
sensor means, said processing mean's further in- 
25 eluding means for extracting information from the 
different image representations to establish data 
representative of the location In space of different 
points on the surface shape. 

2. The system of claim 1 wherein the detect- 
20 able linear features are relatively uniformly distrib- 
uted among the patterns 

3. A system for representing the three-dimen- 
sional surface shape of an object, the systenn^ in- 
cluding radiant energy projection means' for projec- 
ting energy containing distinctive patterns of adja- 
cent areas for projection onto the object whose 
surface shape is to be represented, the patterns 
defining on the object a plurality of distinctively 
located profile lines defined by the linear boundary 

40 between each pair of adjacent distinctive areas m 
the projected patterns, the boundaries in each pat- 
tern being positioned according to a code such that 
the locations of the boundaries in the different 
patterns are at different distinct locations therein. 

image sensor means positoned to observe the 
patterns projected on to the surface of the object, 
said sensor means including means for producing 
reoresentatinnc nf coiQ/-f«w nroiected 
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representations of selected ones of the projec 
patterns including the profiles, and 
50 means for processing the data observed and 

produced as representations by the sensor means 
in at least two distinct patterns, said processing 
means containing processing data representative ot 
the relative positions in space of the projection 
55 means and the image sensor means, ssid process- 
ing means further Including means for correlating 
data from the different image represefitations tak- 
ing into account the relative positions of the projec- 



39 



BP 0 294 577 A1 



40 



tor and sensor means for producing therefronn data 
representations of different locations in space that 
correspond to points on the object. 

4. The system of claim 3 wherein the linear 
boundary lines are relatively uniformly distributed 
among the patterns. 

5. A system for use in representing the three- 
dimensional surface shape of an object, the system 
including radiant energy projection means, means 
responsive to energy projected by the projection 
means and control means for the projection and 
responsive means, the projection means including 
a source of energy capable of being controlled to 
produce projected energy flashes, means to focus 
radiant energy from the projector onto an object 
whose surface shape is to be represented, and an 
energy transmissivity encoding member mounted 
in alignment v/ith the energy source and the focus- 
ing means, said encoding member having a pattern 
formed thereon by a plurality of adjacent relatively 
energy conducting and non energy-conducting 
areas arranged to extend over a portion of the 
surface thereof in the region aligned with the en- 
ergy source and the focusing means, the pattern 
being segmented into a piuariity of discrete seg- 
ments each having distinctively positioned loca- 
tions and widths corresponding to the energy con- 
ducting and non energy-conducting areas thereof 
so that regardless of which segment is positioned 
in alignment with the energy source and its asso- 
ciated focusing means at the time a flash from the 
energy source is projected, the projected energy 
will produce a distinctive intensity pattern on the 
surface of the object defining on the object a 
plurality of distinctly located - profile lines at loca- 
tions defined by each pair of adjacent energy con- 
ducting and non-energy conducting areas on the 
encoding member. 

6. The system claim 6- wherein the source of 
energy is a light source and the energy conducting 
and non energy-conducting areas on the encoding 
member are substantailly light conducting and sub- 
stantially non light-conducting areas on the encod- 
ing member. 

7. The system of claim 6 wherein the locations 
and widths of the light conducting and non light- 
conducting areas on the encoding member are 
determined by a code having distinct code portions 

■ that determine the locations and widths of each of 
the light conducting and non light-conducting areas 
in each segment of the pattern. 

8. The system of claim 6 wherein the code is a 
concatenated binar/ code having a distinctive sub- 
portion associated with each pattern segment, each 
sub-portion having a plurality of positions repre- 
senting respectively each of the light conducting 
and non light-conducting areas of each of the cor- 
responding pattern segments. 



9. The system of claim 6 including a light tigh 
enclosure having positions therein for mounting a 
object to be represented, said light enclosure ais^ 
having spaced positions therein for 

5 plurality of projection means and a plurality of iQ 
responsive means. . 

10. The system of claim 6 wherein the proi 
tion means has a housing with means therein ^o^ 
rotatably supporting the encoding member the e 

70 coding member being optically encoded, spac 
first and second sources of light in the 
locations on one side of the optically 
member, and a separate lens assembly associa 
with the first and second light sources in P^^^^*^"^^^ 

;5 focus light from the respective light sources o 
the object. -3 

11. The system of claim 5 wherein the mea^^ 
responsive include video camera means 
means associated therewith to produce a ras^^^ 

20 onto which the images formed from the pa 
projected onto the object by the projection me 
as viewed thereby can be registered. 

12. The system of claim 6 wherein the p 
tions and the widths of the light conducting 

25 non light-conducting areas on the encoding ^^^^^ 
ber are established according to a ^^j^g 
code having one position for each light con u ^^^^ 
and one position for each non light-conducting 
in each segment. code 

30 13. The system of claim 12 wherein eacti^ 

position is represented by a six-bit binary "^^-^ .^^j^ 

14. The system of claim 13 including a so ^^^^ 
code associated with the multi-position ^"^^^^ 
solution code having a plurality of positions e 

35 which corresponds to one or more positions 

multi-position code. repre- 

15. Means for producing a "^®^^^[f between 
sentation of an boundary formed by and .^^ 
adjacent lighted and non-lighted areas pr J 

40 onto an object comprising ^^^^ 
a projector having a light source ano^ ^^^^ 
system positioned for projecting lig^^^ ^^^^ 
source onto an object. 

a film member positioned in alignmem ^^^^^ 
45 light source and the lens system, said him m ^^^^ 
having at least two adjacent distinct 
formed of differently optically encoded P^^^^^^^giy 
eluding patterns formed by adjacent r ^ 
transparent and opaque areas through w ^^^^ 
50 from the light source passes as it is proje 

the lens system onto the object. lation to 

means to move the film member m re ^^^^^ 
the light source whereby at least two ^^^^'JJ^ object 
of encoded patterns are projected onto 
55 at different times, -ector and 

camera means spaced from the proj 
oriented to view the object and at least ^ ^ ^.^g 
the encoded patterns projected thereon 
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projector, said camera means having a (ens system 
recused on the object and on an image plane Inl,^ 

means for electronically producing a separate 
tern??:" focusedTa^ 
app^^ed when each of the distinct differently op ' 
cany encoded patterns is projected thereon to pro- 
duce image representations thereof on the respec- 
tive separate grid patterns, ^ 

means for storing the separate representations 
pnoduced When the at least two differently optSy 

orfhe' o'SeT °" "'^ ""^^^^ - ~ 
means including first image scanning means 

m asureS/' °' 
nn l ^^P^®^^"tative of selected locations 

for e".^h° ^^'•'^ "measurement pai 

or each location identifying the coordinates of the 
locafon on the grid pattern where a linear feature 

parent and opaque encoded areas on the film 
member as projected onto the object occur:, an" 
owier measurement indicating whether the light 
transition occuring thereat as sensed by the scan 

l-ght transition in the projected pattern, and 
for nrnf '"'""'^'"^ '"^^^^ S'^anning means 
grid pattern onto which the different optically en- 
coded patterns are projected, said other sc nnfng 
means responding to the location information pro 
duced by the first scanning means to produce 
mforma„on for each location for which measurs- 
ment pairs are produced indicating at the cor- 
espon ,ng locations on the grid pLm whether 
that location on the grid pattern on which the 
different optically encoded images are projected I's 
•n a light or dark portion of the pattern. 

16. The means of claim 15 including means for 
3tonng information representa«ve of the'locSon on 
He respective grid patterns where at ieas° t^o 
linear features occur, and 

thr«« "^^ans programmed to produce a 

tion Of r"'L°"^' ^^P^^^^"«ation of at least a por- 
tion Of the object along which one of said linear 

duceTh '''' f^^'^- b^'-ng p^ 

call tn ' P^°i«<=tin9 one of said opti- 

earner. "^^ ""^'^''^ by L 

camera viewing at least a portion of one of (he 

-:on:~s:?r^~ 

00 caV"!? '^"^ ^V3^m nd 

op ically encoded pattern forming means posi- 
tioned m optical alignment therewith, said pattern 



forming means including a disc having annular 
patterns of light encoded areas positioned thereon, 
means for rotating the disc so that the annular 
encoded areas move relative to the light source 
s and the lens system, the annular area including a 
plurality of adjacent circumferentialiy positioned 
segments each formed by a plurality of adjacent 
light conducting and non light-conducting areas 
capable of projecting patterns which are character- 
'0 ized by having distinct boundary lines formed by 
and between each adjacent light conducting and 
non light-conducting area, the locations of the 
boundary lines projected by the areas in each 
segment being located at distinctively different po- 
'5 sitions. 

18. The means of claim 17 wherein the coded 
light conducting and non light-conducting areas are 
circumferentialiy extended elongated areas. 

19. The means of claim 18 wherein the ioca- 
20 tions of the light conducting and non light-conduct- 
ing areas in the different segments are determined 
according to a code' characterized by a base sub- 
|3attern of coded information including a distinct 
first set of bit information for each segment, said 

25 bit information for each set corresponding to a unit 
width measure of displacement along the width of 
said segment, said sets including bits of informa- 
tion representative of the width of the light conduct- 
ing and the non light-conducting areas and hence 
30 the locations where the projected linear features 
occur, the formula for the code being such that no 
two linear features occur at the same location. 

20. The means of claim 19 wherein information 

in each set is such that all projected linear features 

35 are separated by a predetermined minimum dis- 
tance. 

21. The means of claim 20 wherein said mini- 
mum separation distance is 3 unit widths of dis- 
placement. 

"0 22. The means of claim 17 wherein the loca- 
tions of light-conducting areas and non light-con- 
ducting areas on the encoded disc are determined 
by trial and error. 

23. The means of claim 19 including a second 
« subpattern of coded information for extending the 
base subpattern of coded information to create a 
longer patten of coded information, said second 
subpattern being derived from said base subpat- 
tern. 

5° 24. The means of claim 23 wherein said sec- 
ond subpattern is derived from said base subpat- 
tern by cycling and shortening said base subpat 
tern such that the longer pattern maintains connpli 
ance with the formula code used to create the base 
55 subpattern. 
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25. The means of claim 24 including additional 
subpatterns or further extending the longer pattern, 
said additional subpatterns being derived from the 
existing base and second subpattsrn. 

26. A system for creating data to represent a 5 
non-patterned image three-dimensional surface 
hape comprising 

means for projecting onto the illuminated 
sun'ace a shape a sequence of pattern views for- 
mulated by passing through pattern masks chosen w 
such that selected locations on the illuminated sur- 
face shape occur in an illuminated portions of the 
surface shape on at least one of the projected 
pattern views in the ssequence, 

means selecting a maximu intensity of all 75 
portions of the projected pattern means in the 
sequence, 

sensor means postioned at spaced location 
from the surface shape in postion to observe dis- 
tinctive projected pattern views on the surface 20 
shape and to produce representations thereof, and 

means for processing representations of at 
least two projected pattern view as represented by 
the sensor means, said processing means contain- 
ing processing data representative of the relative 2S 
positons and space of the surface shape to be 
represented, the projection means, and the sensor 
means said processing establishing at predeter- 
mined location of selected one of the pattern views 
to establish a maximum intensity of selected im- 30 
ages therein. 
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